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Abstract 

In this paper we consider the problem of coordinating robotic systems with differ¬ 
ent kinematics, sensing and vision capabilities to achieve certain mission goals. An 
approach that makes use of a heterogeneous team of agents has several advantages 
when cost, integration of capabilities, or large search areas need to be considered. A 
heterogeneous team allows for the robots to become “specialized”, accomplish sub-goals 
more effectively, and thus increase the overall mission efficiency. Two main scenarios 
are considered in this work. In the first case study we exploit mobility to implement 
a power control algorithm that increases the Signal to Interference plus Noise Ratio 
(SINR) among certain members of the network. We create realistic sensing fields and 
manipulation by using the geometric properties of the sensor field-of-view and the 
manipulability metric, respectively. The control strategy for each agent of the hete¬ 
rogeneous system is governed by an artificial physics law that considers the different 
kinematics of the agents and the environment, in a decentralized fashion. Through 
simulation results we show that the network is able to stay connected at all times 
and covers the environment well. The second scenario studied in this paper is the 
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biologically-inspired coordination of heterogeneous physical robotic systems. A team 
of ground rovers, designed to emulate desert seed-harvester ants, explore an experimen¬ 
tal area using behaviors fine-tuned in simulation by a genetic algorithm. Our robots 
coordinate with a base station and collect clusters of resources scattered within the 
experimental space. We demonstrate experimentally that through coordination with 
an aerial vehicle, our ant-like ground robots are able to collect resources two times 
faster than without the use of heterogeneous coordination. 


1 Introduction 

In recent years we have witnessed an increase in the use of mobile robots for different appli¬ 
cations spanning from military to civilian operations. Search and rescue missions, disaster 
relief operations, and surveillance are just few examples of scenarios where the use of au¬ 
tonomous and intelligent robotic systems is preferred over the use of human hrst responders. 
In such operations wireless communication needs to be reliable over the robotic network 
to maneuver the unmanned vehicles and transmit information. We are interested in hete¬ 
rogeneous robotic systems with agents having different kinematics, sensing behaviors, and 
functionalities. For instance we will consider quadrotor aerial vehicles, that can be approx¬ 
imated as holonomic agents, interacting with ground robots {e.g., non-holonomic, car-like 
agents), both with different communication ranges and sensing and manipulation patterns. 
Fig. [T] shows an example of heterogeneous systems with quadrotors cooperating with ground 
vehicles and crawling agents, all systems acting as communication and sensing relays. 
Within this paper the contribution to the current research on distributed robotic systems is 
fourfold: i) we consider heterogeneous robotic systems with different dynamics and realistic 
communication analysis, sensing geometries, and manipulation constraints, in a decentralized 
fashion; ii) we build a power control algorithm for communication purposes to improve 
the SINK among certain members of the network; iii) we extend our previous work 
considering a more general and realistic scenario while showing that the heterogeneous system 
stays connected all the time; and iv) we consider a biologically-inspired scenario to coordinate 
heterogeneous robots to harvest resources in an unmapped area. Throughout this work we 
integrate together several tools for coordination and control of distributed heterogeneous 
robotic systems. 

1.1 Related Work 

Heterogeneity in robotic applications is attracting recent attention because of the challenges 
created by multi-agent systems having different kinematics, sensing, and manipulation capa¬ 
bilities. Authors in consider formally a heterogeneous system and analyze its properties 
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Figure 1: (a) A group of iAnt robots (Biological Computation Laboratory) cooperating with an AR.Drone 
[^; (b) Deployment of the OctoRoACH crawling robot using a quadrotor (MARHES Laboratory); 
and (c) An example of aerial mobile relay with four directional antennas. 


based on graph coloring techniques to assign colors to different types of agents. Similarly 
to the work presented in this paper, authors in use agents with different dynamics and 
capabilities to execute multiple missions in a decentralized fashion considering task sequenc¬ 
ing and a consensus-based technique. In the authors introduce control laws based on 
differential potential for aggregation and segregation of biologically inspired heterogeneous 
agents. 

In missions involving multi-agent systems, it is necessary to consider wireless communication 
to maintain network connectivity at all times. The robotics and control community are very 
active in investigating the integration of communication in robotics applications, because 
the uncertainties found in wireless channels can compromise the performance of the entire 
multi-agent system. For instance, authors in propose a modified Traveling Salesperson 
Problem to navigate an underwater vehicle in a sensor field, using a realistic model that 


considers acoustic communication fading effects. In 11 a Rician fading model for the com¬ 


munication channel is utilized in a pursuit-evasion game with two mobile agents moving in 


a cluttered environment. In 12 the authors optimize routing probabilities to ensure desired 


communication rates while using a distributed hybrid approach. In 13 we tether a chain 


of mobile routers to keep line-of-sight communication between a base station and a user 


that moves in a concave environment. Authors in 14 show extensive experimental results 


to optimize the communication throughput by making small variations in the positions of 
agents in the environment. 


Similarly to the work presented in this paper, the authors in 15 present a multi-agent 


system with interaction between aerial and ground vehicles based on task assignment for 


complex missions. From a graph-theoretical point of view 16 surveys graph connectivity 


in mobile robot swarms, discussing different approaches and algorithms to maintain and 
optimize connectivity among mobile robot networks. Still from a connectivity perspective. 


authors in 17 use position information to maintain a network of mobile robots connected 
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without the need of communication among the agents. 

The communication community has been investigating cognitive radio antennas to improve 

These devices change the transmission and reception 


the SINK in cellular networks 18 


parameters to improve the overall communication quality. One of the most common ways 
to improve the SINK is to use Power Control (PC) algorithms in which all wireless devices 
adjust their power level to reach a desired SINK threshold 19-21 . In the work presented 


in this paper we consider a similar PC approach, but we exploit the mobility of the mobile 
agents to change the received power at a certain location and reach a desired SINK. 

Finally from a sensing point of view, authors in present an optimization framework to 
maneuver aerial vehicles equipped with cameras to perceive a certain area based on held of 
view properties. 

The remainder of this paper is organized as follows. In Section]^ we dehne the heterogeneous 
system and formulate the connectivity problem considering relay, sensor, and manipulator 
agents. In Section we present the hrst case study in which aerial vehicles, sensor agents, 
and mobile manipulators cover a cluttered area in search of a hxed target protected by 
an opposing player. We analyze a power control method to improve the SINK over the 
network and we consider sensing and manipulation constraints. In Section we introduce 
a biologically-inspired technique to coordinate groups of ant-inspired robots together with 
an aerial drone to collect resources without central control. Simulation and experimental 
results are presented to validate the proposed strategies. Finally, we draw conclusions and 
outline future work in Section [5] . 


2 Heterogeneous Connected Robotic System 

In this section we give a formal dehnition of a heterogeneous robotic network followed by 
the problem formulation and connectivity constraints used to create interactions among the 
hybrid network. 

Definition 2.1. (Heterogeneous System): A network of M robots is called heterogeneous if 
the members of the network are interconnected, act together toward a common objective and 
if the following conditions hold: 

• one or more agents in the network have different motion dynamics with respect to other 
agents in the system; 

• one or more agents in the network have different sensing/manipulation constraints or 
improved wireless communications abilities with respect to other agents in the systems, 
but all agents have at least some wireless communication capabilities. 
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2.1 Heterogeneous Network Topology 


While the theoretical analysis presented here can be generalized for any type of network, we 
decide to focus on heterogeneous groups made of three types of mobile agents: 

• Me communication relays with communication range i?c > 0 and holonomic kinematics 
(he., aerial vehicles like quadrotors). The set of relays is denoted by Ac- 

• Ms mobile sensors with communication range 0 < and non-holonomic kine¬ 

matics given by the bicycle model 
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where L is the distance between the front and rear axles, v is the velocity, w is the 
steering command described by a 1®* order linear servo model, is the servo gain, and 
is the desired steering angle. The set of all mobile sensors is denoted by As- 

• Mm manipulator agents with communication range 0 < Rm{= Rs) < Rc and non- 
holonomic kinematics ([^.The set of all manipulators is denoted by Am- 


The specihe problem we are interested in this paper is the following: 


Problem 2.2. Deployment of Heterogeneous Robotic Networks: Given a hetero¬ 
geneous robotic network of M agents partitioned by Me, Ms, and Mm, find a set of feasible 
policies Uj G W for each agent such that the workspace of interest W is well covered, the net¬ 
work is always connected to a fixed base station b, and it is possible to reach and manipulate 
a target V protected by an adversarial opponent T having unknown dynamics U7-. 


The adversarial opponent attempts to capture the manipulator agents while the mobile 
sensors try to pursue and capture the adversary, if detected. 

Each agent in the group has some sensing capabilities that are explored in detail in the 
following sections. For now we will focus on the connectivity problem and formulate an 
algorithm to expand the network and cover a specihe environment. 


2.2 Connectivity Constraints 

Following our previous work we build a connectivity algorithm by taking advantage of 
the communication properties of the heterogeneous network. Specihcally we formulate con- 
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nectivity constraints to expand the input set (accelerations, velocities, and in turn positions) 
the agents can choose from, while still guaranteeing connectivity at all times. 

We dehne that a relay agent i can communicate with another relay agent j if and only if j G 
with = i3(xj, Rc) the ball centered in i of radius Re- A mobile sensor k (or equivalently a 
mobile manipulator q) can communicate with a relay i if and only if fc(or q) & B\ = Rg). 
However a relay agent i can communicate with a mobile sensor k (or equivalently a mobile 
manipulator q) if fc(org) G = B{'Xi,Rc). Therefore, by exploiting this last constraint 
we can expand the sensor and manipulator agents in the environment relaxing continuous 
bidirectional communication constraints and thus explore a larger area of the workspace. 
These agents return within range of bidirectional communication with the relay when they 
have information relevant to the entire network. 

At the beginning of a mission we consider a connected graph having the nodes placed in 
random positions. Also we create the following initial conditions 

Vf G Ac, 3j e Ac, i ^ j s.t. i G H(xj, Rc) 

Wk G {As,Am},^i e Ac s.t. k G B{'Xj,Rc) 


In order to have a uniform graph and maximize the coverage of a space, while maintaining 
connectivity, the connections between the agents of the heterogeneous system are biased 
based on the geometry of the communication radii. Since the sensor and manipulator agents 
have limited communication capabilities, the main idea is to have the communication relays 
connect to each other and expand the entire network in the environment. We consider that 
each communication relay is equipped with a high performance rf device that offers a large 
range and bandwidth to handle the communication with multiple nodes. Hence, each sensor 
and manipulator will be connected directly to a specihe communication relay based on the 
minimum euclidean distance to the closest relay. The sensor/relay and manipulator/relay 
assignments are built based on a local consensus algorithm described in Algorithm [1} 
Specihcally in Algorithm C® and C* are the set of neighbor relays and mobile sensors 
connected to the communication relay, respectively, n* is the number of sensors connected 
to the relay and hi the updated number of sensors after running the algorithm. Finally 
is the set containing J\fj communication relays connected to i with nj < Ui. Note that 
Algorithm applies also to the manipulator agents in which we will have to consider C/ 
mobile manipulators’ neighbors connected to h If the graph is connected, then we can 
guarantee the network will reach at least a local consensus that is given by the average 
number of sensors and manipulators connected to the relays in the neighborhood of the 


relay 23 
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Algorithm 1 Heterogeneous Local Consensus Algorithm 


while t < tfinai do 

for i = 1,... ,Afc do 

Calculate the round down average number of sensor agents in the neighborhood of i 


rii+Yl 


{jeCl\nj<rn} J 

A/'i+l 


for j = 1,... do 

if 3 A: G A* s.t. rii = rij'ij G {A* \ k} and rij. < {rii — 2) then 


hfc — Ufe + 
hi = ni- 

else 


(rtfc+nt) 

2 

(rtfc+nj) 


r; = Ti- uj 

= rij + rj 


rii = Hi 


T- 


for / = 1,..., rj do 
if 3p G (C* n Bi) s.t. 
p G Cj and p ^C\ 

end if 
end for 
end if 
end for 
end for 
return n* = hi 
end while 


|xp — Xjj I = min | |xg — Xj 11Vg G Cj then 


3 A Real World Inspired Coordination of Connected 
Heterogeneous Robotic Systems 

In this section we present a framework to coordinate heterogeneous networks of aerial and 
ground agents while considering realistic communication, sensing, and manipulation con¬ 
straints. We demonstrate the applicability of the proposed algorithm throughout a pursuit 
and evasion simulation [^. 

3.1 Motion Constraints 

• Relay agent Given ([^, V sensors k E Cl (or manipulators q G C^), if ||xj — Xfc(q)|| < R^, 
with Rs{Rm) < Re < Rc, the motion of the communication relay follows the spring-mass 
interaction 

Xj = Uj, 
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Ui = 


5i±^ - Vx,<^(xi), 


( 3 ) 




^ij {J'ij -^e) 


where Ui E U {U E M^) is the control input, Xj = {xi,yi,Zi)'^ is the position vector of the 
relay relative to a hxed Euclidean frame, and Xj, Xj denote the velocity and acceleration 
(control input), respectively. C* is the set of neighbor relays connected to the relay. C® is 


built using the Gabriel Graph rule 24 in which between any two nodes i and j, we form a 

h 


virtual spring if and only if there is no robot k inside the circle of diameter ij. 
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and 


dij are the length and direction of force of the virtual spring between robot i and j while 
K,ij and 5i are the spring constant and damping coefficient, respectively. Here, we assume 
Kij = Kji and 6i > 0. Vxi<t(xj) = H^(xj — c^) is the gradient of ^||xj — a quadratic 
attractive potential function where is the center of the region where the target is located 
and it is known a priori. 


Theorem 3.1. A network of communication relays having switching dynamics depicted in 
(|^ is guaranteed to eventually reach stability in which all agents converge to a null state. 


Proof. The proof for this theorem can be formulated using Lyapunov theory and can be 
found in our previous work 24 . □ 


If 3/c G C* such that < ||xj — x^H < Rc then the relay node believes that the specihc 
sensor agent k is in pursuit mode; therefore it switches into a follower mode with dynamics 


Uj = Q;(xfc - Xi) 


(4) 


where a G M"*". 

• Sensor agent. We consider the following interaction 

{ ^ki (.Iki Rs') df^i if /l G Rs') 

^search if fc G {i3(Xj, Rf) \ i3(Xj, , (5) 

Upursuit if k is in pursuit mode 

in which with Ugearch we intend a random motion within the toroid centered in the relay 
controlling the k^^ mobile sensor. \ is the set-minus operator. 

• Manipulator agent: We similarly consider the following logic 


^qi (,^qi -^m) ^qi * 

5i±g if g G H(xi, Rm) 


^search 

A q E {B{xi,R,)\B{xi,Rm)} , 

(6) 

^manip 

if q is in manipulation mode 
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Specifically for the search modes in both (|^ and @ we create the following connectivity 
constraints: at every At time the communication relay transmits its location to its neighbors. 
Given f^e maximum velocity of each relay, the maximum distance the relay can travel 
in At time is = V^^^ At. Thus when in search mode, agents are guaranteed to stay 

in search mode if and only if in an interval of time At they don’t enter inside the region 
— T*max)) \ important to note that when in pursuit 

mode, if A: G {i3(xj,i?c) \ the communication relay i is not attracted anymore 

toward the target region but switches into following mode with dynamics (3.1) to maintain 
connectivity to pursuer k. 

We can formulate the following theorem that guarantees connectivity among the heteroge¬ 
neous network at all times: 


Theorem 3.2. Given an initially connected heterogeneous robotic system made of Me relays, 
Ms mobile sensors, and Mm manipulator agents with switching topologies expressed by (|^, 
, (g, the network is guaranteed to maintain connectivity if for an interval of time 
At > 0, each j G G*, k G G*, and q G G^ take goal points 9pk){q) ^ 
with e{At) > 



Proof. Assuming that the dynamics of each agent are stable or at least stabilizable, if g^ G 
BMiit), {Rc — e{At))), then Xj(f -|- At) G i3(xj(t), e(At)) shifting the communication region 
of e(Af), thus leaving Xj(t -|- At) G i3(xj(t), e(At)) C BMj{t), {Rc — e{At))). Hence, j is 
always connected to i. Note that e{At) is an upper (and safe) bound for the sensor k and 
manipulator q agents since > "l^max = "l^max- ^ 


Corollary 3.3. A sensor agent k connected to the M 
guaranteed to be in search mode at all times if ||xfc — : 


relay with dynamical topology g is 
Q11 > Rs and for an interval of time 


At > 0, gl ^ ((i3(xj(f), {Rc — e{At))) \ B{'Xi{t), {Rg + e{At)))) with e{At) as of Theorem 3.2. 


Proof. The proof for this corollary extends from the proof of Theorem 3.2 and it is based 
on the geometrical properties of the connectivity constraints imposed in g. Corollary 3.3 
applies to the manipulators agents, as well. □ 


Within Corollary |3.3| we allow the communication relays to move freely and expand in the 
environment while the sensor and manipulator agents are in search mode without entering 
in other regions. Thus k can take a goal G {B{'Xi, {Rc))\B{'Xi, {Rc — e{At)))) only if it detects 
an intruder. In the same way, q can take a goal G {B{'Xi, {Rc))) \ B{'Xi, {Rc — e{At)))) if and 
only if it detects the target T. 
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3.2 Communication Power Control 


In this section we introduce a power control algorithm to maintain a certain SINK level 
between the agents of the heterogeneous robotic network. 

Depending on the distance between the robots as well as path loss, fading, and shadowing, 
the power received at a certain mobile sensor (or manipulator) k that is transmitted by a 
relay r is atterruated by a gairr = Jb (i)' + if where K is a constant that depends 
on antenna properties and channel attenuation, Iq is a reference distance, and Uk is the 
separation distance between robots i and k. /3 is the path-loss exponent and finally if^ik is 
an additional attenuation due to shadowing and that is usually a log-normal distributed 
random variable [^. i can communicate with k provided its (SINK) is above a certain 
threshold T. Thus the goal is to find whether there exists an assignment of power levels and 
distance between robots so that each robot’s SINK is acceptable. Since Qik depends on the 
distance separation between node i and j, instead of regulating the power, we can think 
of changing kk to maintain the SINK above a desired value. Therefore, we can implement 
the following algorithm 

find Vz = 1,..., A/'c, (7) 

keci 


subject to: 


J_ Pjgik _I > T 

0 < P* < Pmax, 

kk > /min Vz = 1, . . . , AAc, V/c e Q. 


( 8 ) 


where /min is the minimum distance separation between any agent in order to avoid collision. 
Pmax is an upper bound for the maximum power each agent can have, P* is the power level 
of agent z, and Vk the receiver noise at the sensor. For simplicity’s sake we assume that 
the Vk can be neglected. In other words, by implementing this algorithm we guarantee a 
certain quality of service (QoS) among the robotic team and adjust the received power at k 
through mobility. 


3.3 Sensing & Manipulation 

In this work we consider two distinct sensing behaviors: a vision capability and a obstacle 
avoidance characteristic, as depicted in Fig|^a-b). The former implies the use of camera 
like systems in which we are able to perceive different features in the environment and for 
instance recognize friends and foes, targets and other characteristics of the environment. 
Within the obstacle avoidance, we consider laser range finder type sensors that are capable 
of measuring distances with high precision and thus can be employed for navigation. Finally 
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Figure 2: Representation of the sensing capabilities for the aerial relay and mobile sensor, (a) The aerial 
relay i hovers at a certain height hi and has a toroidal sensing for obstacle avoidance and a conical field 
of view over the ground, (b) The sensor agent k (and also the manipulator q) has a toroidal sensing for 
obstacle avoidance and a limited field of view in front of it. T is a target of interest, (c) Representation of 
the manipulator configuration used in this work. For ease, here we consider a two link planar arm with end 
effector, installed on the top, frontal position of the robot. 


the manipulator agents are equipped with a planar arm to lift or move objects 


3.3.1 Vision Detection 


In the scenario envisioned in this paper, each robot has some degree of vision capability. 
The aerial relay can see a large area but with low resolution, while the sensor and the 
manipulator agents on the contrary can perceive a smaller area but with higher resolution. 
Following Figj^ we use the following probability of detection held for the aerial relays 




N {ci,ip^) if ||x- 7 — Ci\ \ < Sj and h* = const. 
0 otherwise 


(9) 


where X 7 - is the state (he., the position) of a target T located in a 3D workspace. N(cj, ^pj) 
is the held of view normal distribution centered in q with variance (pf. || ■ || is the euclidean 
distance norm and Sj is the maximum vision range for the aerial relay. Model ([^ holds 
if the quadrotor is hovering at a constant altitude (hence hi = const.). By using this model, 
the probability of detection is higher moving toward the centroid of the held of view of i. 
Thus if a target T in position X 7 - is such that ||x 7 — Cj|| < Sj, the probability of detection 
(pr) is given by 

pr(xr) = N(ci,v3,2) = —(10) 

p>i\/2n 
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A centroid motion scheme, centering the target in this held of view is discussed in the 
following section 

For the sensor and manipulator agents, similarly we use the following constraint 


‘5fc(x7-) = 



(Sfc-Xfc)-(gt.-xt.) 

2 

(^fc (^fc ^fc) 

2 




if xr G 9k{ 
if Xr G 6k{ 
otherwise 


Xfc 


I C^k+ik) 

I 2 


2 


Xfc 


116 


- XfciF). 

xfclH- 


( 11 ) 

where N(-, •) has the same form of (10). S*, and ^k are the maximum and minimum distances 
perceptible by agent A;, respectively. Finally 26k is fhe viewing angle of k, as represented in 

Fig§b), 


3.3.2 Pursuit Evasion 


If a mobile sensor k detects an adversarial opponent T inside its held of view, it switches 
from search mode into pursuit mode ([^ with the following dynamics 


u 


pursuit 


a(Tr(xr-Cfc)) ifxrG 0 * 


a(xr - Xfc) 


if Xr G 6k 


z: _Y 112 _ 11 Y l| 2 '\ 

'— k II II 2 11 / 

‘~*t^** -xilP - II& -XtIP) 


( 12 ) 


in which T^is the transformation matrix that converts the k^^ robot frame into the world 


W frame, 
matrix. 


where is the rotation matrix and is the translation 

/v A/ rv fV 

25 . x^ and Cfc are the position of the target and held of view centroid in the k^^ 


robot frame, respectively. 


Thus, within the hrst equation in (12) we navigate the centroid Cfc of the held of view of k 


toward xr. Once T is within the region of the constraint in the second equation of ( 12 ), /c is 


guided toward the evader through an attractive potential force. Here we assume that based 
on the velocities of both k and T, T is capturable if X 7 - G 6(1— Xfc|p — ||6 — Xfc|p) 


(that is the constraint in the second equation of ( 12 )) 


3.3.3 Obstacle Avoidance 

For the obstacle avoidance ehect the reader is referred to the toroidal shapes in Figj^ The 
workspace, W, is populated with No hxed polygonal obstacles {Oi,..., Oa/'o}i whose geome¬ 
tries and positions are assumed unknown. In order to avoid obstacles we model a ray held of 
view around the agents, similarly to a laser range hnder footprint, and we create a repulsive 
potential whose value approaches inhnity as the robot approaches the obstacle, and goes to 
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zero if the robot is at a distance greater than or smaller than from the obstacle. 


Wo,i = 


IVi 




if 

PO 


< p(xi) < 

if p(xi) > or p(xi) < (pi 


( 13 ) 


where p(xj) is the shortest distance between the agent and any detected obstacle in the 
workspace and rji is a constant. 

The repulsive force is then equal to the negative gradient of Wo,i For simplicity sake, here 
we assume that the aerial relay, sensor and manipulator agents have all the same obstacle 
avoidance constraint, as depicted in Figj^a-b). 


3.3.4 Manipulability 

For the manipulation behavior we assume that N'm agents are equipped with an articulated 
arm having A/J links. From a classical robotics book, 25 , it is well known that the manipu¬ 
lability metric offers a quantitative measure of the relationship between differential change in 
the end-effector pose relative to differential change in the joint conhguration. In this work, 
we use this concept to dehne the best conhguration of the manipulator agent such that when 
a certain target object needs to be handled, the manipulability measure is maximized. 

Let us dehne the Jacobian relationship 


C = Jd 


(14) 


that specihes the end-ehector velocity that will result when the joint move with velocity d. 
If we consider the set of joint velocities d such that | |a| p = -|- 02 ^ -|- ... < 1, then we 

obtain 


4I|2 = c^(jjq-'c = (f/yyEP((7^o 


(15) 


m 


which we have used the singular value decomposition SVD J = UYiV'^ 25 


If the Jacobian is full rank (rank J = m), (15) dehnes the manipulability ellipsoid. It is easy 
to show that the manipulability measure is given by 


fi — (Ti(T 2 ... dm 


(16) 


with dj the diagonal elements of S. 

For convenience in this work we consider that each manipulator robot is equipped with a 
two-link planar arm (Figj^c)) in which the manipulability measure is given by 

/i =/ 1 / 2 I sin6'2| (17) 
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where li and I 2 are the length of the two links of the manipnlator and 62 is the angle between 
the two links. Therefore, the highest manipnlability measnre is obtained when 62 = /2. 


3.3.5 Target Manipulation 

If a manipnlator agent q detects a hxed target V that needs manipnlation {e.g., lifting, 
moving, grabbing, etc.) then we apply a similar law as in (12) with the only difference 


that once the target is detected, we compnte the conhguration of the manipnlator arm snch 
that we obtain the highest manipnlability measnre p. /i will translate into a certain spatial 
conhgnration and position of the end effector x^. Finally, becomes the inpnt for the 
controller. Thns the control law for q in manipulation mode becomes 


Umanip = (x|, - X^(/i))) if Xx, G Og 


-q - 


- I|XC(/^) -Xq 


(18) 


3.4 Simulation Results 

In the simnlation of Fig. |^we assemble together all the pieces descried in the previons sections 
and consider a search and rescne/pnrsnit-evasion scenario. A heterogeneons system made of 
the same nnmber and type of agents as in the hrst simnlation, explores an environment in 
search of a target V that needs to be manipulated, while maintaining connectivity with a 
hxed base station. The target is protected by an opposing player T that circles around its 
perimeter. T tries to capture the manipulator agent q, while avoiding any mobile sensor k. 
If a mobile sensor k detects T, it switches into pursuit mode to capture the opponent. Here 
we assume that 

Specihcally, during the simulation, while the consensus algorithm is run to equilibrate 
the network, the agents are attracted to a region where the target is located. The relays 
maintain network connectivity and enforce the power control algorithm ([^ keeping the SINK 
above a certain threshold (Fig. |^a)). In Fig. |^b) it is plotted the case in which the agents 
don’t follow the PC algorithm. Specihcally in this case the SINK can take values below 
the threshold, obtaining a lower quality of communication. In Fig. [^b) the sensor and 
manipulator robots switch into search mode and explore the area surrounding their assigned 
communication relay. Finally, in Fig. [^c) a mobile sensor detects the opposing player and 
switches into pursuit mode while a manipulator moves toward the hxed target. 

Additionally, through equivalence comparisons, we found that the average coverage for a 
heterogeneous system is 63% while for the homogeneous scenario is reduced to 22% of the 
workspace. Therefore, by decoupling the tasks of sensing and relaying communication, and 
by imposing the connectivity constraints for a heterogeneous system we can cover a larger 
area with a limited number of mobile agents. 
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(a) 


(b) 


(c) 


Figure 3: Pursuit-evasion simulation, (a) The heterogeneous system is in spring-mass mode, (b) The sensor 
and the manipulator agents are in search mode while the communication relays expand the network in the 
environment, (c) A sensor detects and pursue an adversarial player (top right of the figure making a circular 
trajectory), while a manipulator moves toward the hxed target. The video of the simulation is available at 
http://marhes.ece.unm.edu/index.php/ROBOTICA2013. 




Figure 4: Comparison between SINK (dB) with Power Control (top) and without Power Control (bottom) 
for two mobile sensors and one robotic manipulator assigned to one of the five relays in Fig. 


4 Biologically—Inspired Coordination of Heterogeneous 

Robotic Systems 

In the previous section we demonstrated our heterogeneous coordination framework applied 
to a simulated pursuit-evasion scenario with a single mobile target. We now apply our 
framework to a test bed with physical ground and aerial robots searching for multiple sta- 
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tionary resources. In this scenario, robots are programmed to locate and collect as many 
resources as possible within a hxed amount of time. Our biologically-inspired ground robots 
(depicted in Fig. [^a)) explore the experimental area using biased random walks. The bias 
of a robot’s walk varies when the robot is informed about resource locations. This precludes 
an analytical prediction for how long it will take to retrieve resources with or without the 
aerial drone. Instead we conduct a series of experiments with and without coordination be¬ 
tween the ground robots and an aerial drone, demonstrating the value of the heterogeneous 
coordination framework on a resource collection problem. 

Each experimental trial on a 2.5 m square indoor tile surface runs for approximately 30 
minutes using two ground robots and a single aerial drone. We begin each trial by randomly 
placing 32 barcode-style QR tags in clusters throughout the search area, either in one large 
cluster of 32, or in four smaller clusters of 8 . The ground robots are capable of detecting 
individual tags as they explore the search area over the length of the experiment. Each tag 
cluster is marked with a corresponding roundel-style pattern which can be recognized by 
the drone’s built-in vision tracking system. The aerial drone assists the ground robots by 
guiding them toward the tag clusters, thereby increasing the probability of tag detection. 

In accordance with our dehnition of a heterogeneous coordination framework, the ground 
robots and aerial drone have different motion dynamics and sensing constraints. The aerial 
drone is fast-moving and holonomic with coarse-grained, wide-ranging vision sensors, whereas 
ground robots are slow-moving non-holonomic entities with hne-grained, short-range sen¬ 
sors. Equation ([^ constrains the vision sensing capabilities of both types of robots, although 
the maximum vision range S of the aerial drone is much larger than that of the ground robots. 
As a result, the drone has a high probability of detecting a region of QR tags by recognizing 
the associated roundel pattern, but has zero probability of detecting an individual tag T at 
position X 7 -. Conversely, the ground robots have a high probability of detecting tag T but 
a very low chance of Ending it on their own. 

In this way, each type of robot specializes in recognizing one particular type of symbol, and 
the spatial association of QR tag clusters together with roundel patterns bridges this gap to 
facilitate cooperation. We exploit this cooperation to optimize the probability of detecting 
resources, as in Equation (10), and therefore we expect the rate of resource collection to 
increase relative to non-cooperative or homogeneous robot teams. 


4.1 Cooperative Task and Search Algorithm 

The aerial vehicle executes a deterministic grid search over the experimental area, described 
in Algorithm Resource locations identified by the aerial robot are transmitted to the 
ground robots as pheromone-like waypoints. Communication connectivity is constrained as 
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Algorithm 2 Aerial Robot Search Algorithm 


Ensure: Drone placed at starting location 
Take off and hover 


Follow search pattern in Fig. £ b) by adjnsting pitch and roll 
if ronndel fonnd then 

Transmit message to central server 

Server records drone’s location as a non-decaying pheromone waypoint 

end if 


in Section 2.2, such that the aerial vehicle is assumed to have a much wider communication 
range than the ground robots. The entire experimental area is considered to be a valid range 
for two-way communication with the drone, whereas transmission of resource locations to 
ground robots is permitted only when returning to the central base station ‘nest’. 

Our ground robots execute an ant-inspired central-place foraging task to search for resources 
simultaneously with the aerial vehicle, described in Algorithmic They move in a correlated 
random walk with direction 6 at time t drawn from a normal distribution centered around 
direction 9t-i and standard deviation SD = ca -1- y/tf. u determines the degree of turning 
during an uninformed search. In a search informed by memory or communication, y/tf 
determines an initial additional degree of turning which decreases over time spent searching. 
This mimics biological ants’ tight turns in an initially small area that expand to explore a 


larger area over time 26 


A total of 13 parameters controlling the exploratory process of the ground robots are evolved 
in an agent-based model (ABM) guided by genetic algorithms (GA). Three of these param¬ 
eters govern traveling behavior to and from the nest, three control turning during random 
walks, and seven affect the probability of returning to a found resource location using mem¬ 
ory or communication. We designed the ABM to replicate the constraints of the robot 
hardware, and to model the physical environment in which the robots search. We briefly ad¬ 
dress a subset of the parameters here {e.g., u, y, and 5; also see Algorithmj^; specihcations 
of the full parameter set, the ABM, and it’s relationship with the ground robots are detailed 
in previous work Isl. 


4.2 Test bed 

The ground robots are Arduino-based iAnts [^, autonomous differential drive rovers with 
dynamics expressed in ([^. They are guided only by a heuristic search algorithm with occa¬ 
sional communication via pheromone-like waypoints transmitted between robots through a 
central server (Fig. [^. The iAnts use onboard iPods that provide wireless communication 
and two video cameras, in addition to a compass and ultrasonic rangehnder. 
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Algorithm 3 Ground Robot Search Algorithm 

Disperse from nest to random location 
while running experiment do 

Conduct uninformed correlated random walk 
if tag found then 

Count number of nearby tags d at current location If 
Return to nest with tag 

if d > fp then 

Communicate If as pheromone-like waypoint to central server 
Server transmits pheromones to robots at nest 
Server decays pheromone over time 
else 

if d > ^ then 

Return to If 

Conduct informed correlated random walk 
else 

Request pheromone from server 
if pheromone available and d < ^ then 

Drive to received waypoint Ip 
Conduct informed correlated random walk 
else 

Choose new random location 

end if 
end if 
end if 
end if 
end while 

^ Parameter evolved in simulation using GA, identical across all robots 


Our ground robots coordinate with an aerial vehicle, the Parrot AR.Drone radio-controlled 
quadrotor (Fig. [^. The AR.Drone contains an onboard inertial measurement unit (IMU) to 
control holonomic flight through 6 degrees of freedom (DOF), as well as two video cameras 
with built-in object recognition, and uses an ultrasound telemeter to maintain a consistent 
hover state. 

A central server facilitates all network traffic between the robots, both ground and aerial. 
The server also tracks robot locations throughout the experiment for data logging; occasional 
two-way communication allows virtual pheromones to direct the iAnts to previously found 
tag locations. 

We additionally use a Vicon motion capture system to track the iAnts’ and AR.Drone’s 
ground truth position and orientation. Lateral and longitudinal position measurements of 
the drone are transmitted to the central server as {x, y) pairs whenever the drone detects a 
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Figure 5: (a) One of the iAnt robots used in our heterogeneous experiments; (b) block diagram with the 
sequence of operations performed during the search; and (c) a pictorial representation of the search algorithm. 
The iAnt begins its search at a globally shared central nest site (double circle) and sets a search location. 
The robot then travels to the search site (yellow line). Upon reaching the search location, the robot 
searches for tags (blue line) until tags (black squares) are found. After searching, the robot travels to 
the nest (red line). 



Figure 6: The Parrot AR.Drone (a) uses a deterministic grid search (b) to explore the experimental area 


using a built-in object recognition system to detect roundel patterns (c) 


roundel pattern. Roundels are placed directly adjacent to each cluster of tags as in Fig. 


The server records each position measurement as a virtual pheromone to be transmitted to 


any iAnt returning to the central nest. 


4.3 Results 


We present an analysis of the rates at which iAnts retrieve tags from two different distri¬ 
butions, with and without heterogenous coordination with the AR.Drone. Results for each 
experimental treatment are averaged over three replicants; error bars denote standard error 
of the mean. 

Fig. 7 a) shows a snapshot of the one of the experiments conducted at the Marhes Lab 
with our test bed of heterogeneous robotic systems. A video of the experiment is available 
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at http://swarms. cs. unm. edu/videos, html. 
Fig 


b) shows the rate of tag collection per hour of experiment time. In both the single, 


large cluster and multiple, smaller cluster distributions, we observe that robot teams using 
heterogeneous coordination produce tag collection rates more than double those without 
coordination. 



Figure 7: (a) Physical experiment in progress, (b) Rate of tag discovery per hour of experiment time for large 
and small clusters with and without heterogeneous coordination with the aerial drone. Each bar denotes 
a mean calculated over three replicants; error bars show standard error of each mean. The video of the 
experiment is available at http://swarms.cs.unm.edu/videos.html. 


5 Conclusion 

In this work, we combined realistic communication, sensing, manipulation, and different 
dynamical models to improve the performance of a group of autonomous agents. We managed 
multiple types of robots using our heterogeneous coordination framework to improve the 
search, coverage, and thus the sensed areas in a workspace. 

Besides using realistic sensing and vision capabilities, we have analyzed a communication 
connectivity algorithm to equilibrate and maintain the network connectivity while exploring 
the environment, and a power control algorithm to guarantee a certain SINK level between 
the relay and the sensor and manipulator agents. We presented a simulation scenario in 
which we implemented a search/pursuit-evasion scenario with a heterogenous network. The 
robots expand in the environment attracted by potential functions, avoid a large obstacle 
and reach a partially known target that is manipulated by a specihc agent of the system. 
We also presented an experiment performed with a heterogeneous system of physical ground 
and aerial vehicles. We demonstrated that our biologically-inspired ground robots can col¬ 
lect resources twice as fast through coordination with an aerial vehicle. The drone quickly 
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covers and searches a large area with low-resolution vision sensors, while the slower ground 
agents perceive smaller but higher resolutions portions of the area. By exploiting the specihc 
characteristics of different agents in our heterogeneous system, we showed that the overall 
mission performance can be improved. 

In future work, we will expand the theoretical results of this paper by introducing more 
realistic environments with non-convex obstacles and more opponents, and we will evaluate 
the robustness of our system by simulating failures {e.g., some agents stop working). We will 
also implement additional experiments with several different types of heterogeneous robotic 
systems, and test our system on different distributions of resources. 
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